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Abstract — We consider the decoding of convolutional codes 
using an error trellis constructed based on a submatrix of a 
given checlf matrix. In tlie proposed mettiod, the syndrome- 
subsequence computed using the remaining submatrix is utiUzed 
as auxiUary information for decoding. Then the ML error path 
is correctly decoded using the degenerate error trellis. We also 
show that the decoding complexity of the proposed method is 
basically identical with that of the conventional one based on 
the original error trellis. Next, we apply the method to check 
matrices with monomial entries proposed by Tanner et al. By 
choosing any row of the check matrix as the submatrix for error- 
trellis construction, a 1-state error trellis is obtained. Noting the 
fact that a likelihood-concentration on the all-zero state and the 
states with many O's occurs in the error trellis, we present a 
simplified decoding method based on a 1-state error trellis, from 
which decoding-complexity reduction is realized. 

I. Introduction 

Tanner et al. [10] presented a class of algebraically con- 
structed quasi-cyclic (QC) LDPC codes and their convolutional 
counterparts. Owing to their construction, check matrices of 
obtained LDPC convolutional codes have monomial entries 
and then each column (row) has a common factor of the form 
DK On the other hand, Ariel and Snyders [1] showed that 
when some "column" of a polynomial check matrix H{D) has 
a factor D\ there is a possibility that state-space reduction can 
be realized. For the same case (i.e., some column of H{D) 
has a factor £)'), the authors [9] showed that the results of 
[1] can be equally obtained using shifted error-subsequences. 
These ideas can be directly applied to check matrices with 
monomial entries obtained from the construction of Tanner 
et al. Actually, H{D) can be modified as H'{D) with the 
error-correcting capability being preserved. Let H"{D) be the 
factored-out version of H'{D). Then we [8] showed that the 
state-space complexity of the error trellis based on H"{D) can 
be controlled to some extent. However, the overall constraint 
length of H"{D) is still large and therefore the use of "trellis- 
based" decoding is not feasible. Hence, another complexity 
reduction method is required for trellis-based decoding. In this 
paper, we present a decoding method using an error trellis 
constructed based on a "submatrix" of a given check matrix. 
Note that since some of check conditions are not taken into 
account, the degenerate error trellis contains additional error 
paths not allowed in the original error trellis. We show that the 



ML error path can be correctly decoded using the degenerate 
error trellis, if the syndrome-subsequence computed from 
the remaining submatrix is utilized as side information for 
decoding. In particular, consider check matrices proposed by 
Tanner et al. [10]. If we take any row for the purpose of error- 
trellis construction for decoding, each column (i.e., entry) of 
the row has a factor of the form . Then factoring out these 
factors, a particular submatrix (i.e., row) with all 1 entries is 
obtained and the number of states of the corresponding error 
trellis is one. We propose a sub-optimal decoding algorithm 
based on a 1-state error trellis. Applying the proposed method, 
a considerable decoding-complexity reduction is realized com- 
pared to the conventional one. 

II. Error Trellis Constructed Based on a 
Submatrix of a Check Matrix 

Consider an (n, n — m) convolutional code C over GF{2) 
defined by a canonical [5], [6] check matrix H{D) of size 
m X n. Let v be the overall constraint length of H{D). Denote 
by H'^{D) (T means transpose) the corresponding syndrome 
former Assume that H^{D) has the form 



H^{D) = {H^{D),H^{D)), 



(1) 



where the size of Hi{D) {i = 1, 2) is xn (m = mi +1112) 
and the overall constraint length of Hi{D) {i = 1,2) is ui 
iy = VI+V2)- Assume that Hi{D) {i = 1, 2) is also canonical. 
In this case, for the time-fc error e/j and Ck — (Ci^\ Cfc^"*)' we 
have 



BkH^iD) 



{ekHj{D),ekH^{D)) 



(2) 



Here, it is assumed that given a received data z = {zk}. 



the equation ZkHf (D) 



1,2) holds. The above 



relation implies that the original error path {e^} associated 
with H^{D) can be represented using the error trellis based 
on either -fff (D) or H^{D). 

For example, consider the (3, 1) convolutional code C 
defined by the check matrix 



H{D) 



1 + D D 1 + D 
D 1 1 



(3) 



Fig. 3. The error-trellis modules associated with Hj{D). 
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A degenerate error trellis based on 
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Fig. 1. The error-trelUs modules associated with H'^{D). 
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Fig. 2. An example error trellis based on H^[D). 



An error trellis of C is constructed by concatenating the error- 
trelUs modules [1] associated with iJ^ (D). The set of four 
error-trellis modules associated with H^{D) and an example 
error trellis are depicted in Fig.l and Fig. 2, respectively. It is 
assumed that the corresponding code trellis is terminated in 
the all-zero state at time 5. Hence, the error trellis in Fig. 2 is 
terminated in state (00), which corresponds to the syndrome- 



former state 0-5 



i4\ 



CTg^') (cf. Fig.5). From Fig.2, we 



have eight admissible error paths, e = 000 100 000 100 000 
corresponds to the ML error path e. 

Now, partition H^{D) vertically into two submatrices, i.e.. 



H^{D) = 




As stated above, the original error paths {cfe} can be equally 
represented using the error trellis based on H^iD). The set of 
error-trellis modules associated with Hj^iD) and the overall 
error trelhs are shown in Fig. 3 and Fig.4, respectively. Since 
a^^' = 0, the error trellis in Fig.4 is terminated in state (0) at 
time 5. We remark that the additional error paths not allowed 
in the original error trellis are included in the error trellis in 
Fig.4. This is because the condition ekHi{D) 
taken into account for error-trelUs construction. 



Cj^^ is not 



III. Structure of Degenerate Error-Trellis 
Modules 

A. Observer Canonical Form of a Syndrome Former and 
Degenerate Error-Trellis Modules 

Consider the trelUs modules with values Cfe^"* Ci^^ = 00 and 
10 in Fig.l. We see that these trellis modules degenerate into 
the trellis module with value C/c = in Fig. 3, if two states 
with the same second component are identified. In the same 
way, two trellis modules with values = 01 and 11 

in Fig.l degenerate into the trellis module with value Cfc = 1 
in Fig. 3. That is, the trellis modules associated with H2 (D) 
are obtained from the trellis modules associated with H^{D). 
In this case, two trelhs modules with the same syndrome bit 




A 



{Hl{D),Hl{D)). 



(4) 



Fig. 5. Adjoint-obvious reaUzation (observer canonical form) of the syndrome 
former {D) in (3). 



(2) 

C ^ degenerate into the identical trellis module with value 

(2) 

Q . This fact is derived from an adjoint-obvious realization 
(observer canonical form [3]) of the syndrome former H^{D) 
(see Fig.5). Note that two pairs (ctj.^^ , <^l^^) and {a^^^ , C^^) are 
independent of each other, from which the above observation 
is obtained. In general, error-trellis module degeneration is 
closely related to a reaUzation of the syndrome former. Let 



H^{D)^ihl{D),h^iD),---,hl{D)) 



(5) 



and consider the observer canonical form [3] of the syndrome 
former H^\D) (cf. Fig.5). Denote by i/^'^ and L the maximum 
degree among the polynomials of hq{D) (1 < q < m) and 
the maximum degree among the entries of H{D), respectively. 
Since equations ekh^ (D) ~ c}^}^ (1 < g < m) are indepen- 
dent of one another, a realization of H^{D) is obtained by 
combining the realizations of h^{D) in a parallel way (cf. 

Fig.5). Let (T^p (1 < p < L) be the contents of the memory 
elements in the realization of h^{D). (For any fixed q, a^?^ 
represents the memory element which is closest to the output 



Cfc .) Using a)^"', the state [9] of H^{D) is defined as 



'kp 



fci ' 



'kL^ 



(6) 



(9) 



Here, if a memory element is missing, the corresponding a, 

is set to zero. Hence, the size of crk is i' = i^^^^ H h f^"^'. 

In the following, H^{D) is assumed to have the form 

H^{D) = {HJ{D),H^{D)), 

where the same conditions as in Section II are assumed. 
Denote by a\ and Q)^ the state and syndrome at time 
k corresponding to Hj (D) (i = 1,2), respectively. From 
the definition of cr^, cr), {i — 1,2) may not consist of 
consecutive components of the state <7fc. However, the total 
of cr^'^ (i = 1, 2) coincides with cTfe as a whole. We have the 
following. 

Proposition 1: The error-trellis module with value ci^^ as- 
sociated with Hi{D) is obtained from the error-trellis module 
with value c}p c}^'' associated with H^{D) by reducing the 



state (c^fc^^<'■fc^O to the state cr)^' ■ In this case, the trellis 
modules with the same syndrome component C^^^ degenerate 
into the identical trellis module with value C}]^ ■ 

Proof: Assume that the syndrome former H^(D) is in 
state crfe_i = (<t[,^2i, ci^i) and an error is inputted to the 
syndrome former. Then it goes to state <Tk = {'^^k\'^^k^) and 
outputs the syndrome Q^. = (Ci'^^Ci^^)- Here, owing to the 
independence of the first component from the second one, if 
efc is inputted to the syndrome former Hj{D), then it goes 
from state (t'"1\ to state a']^ and outputs the syndrome c!]^ 
independently of the second component. This fact implies that 
the degenerate trellis module with value associated with 
Hi(D) is obtained from the trellis module with value ci^'^Ci^^ 
associated with H^{D). ■ 



(1) 



B. Relationship Between Degenerate Error-Trellis Modules 
and the Original Error-Trellis Modules 

Consider any branch, e.g., the branch = 000 in the trellis 
module with value Cfe = in Fig. 3. Let c^J.! = (0) be the 
state at time fc — 1 of the branch. If this trelUs module is 



00, 



obtained from the trellis module with value Q^^Q^^ 
then iy\^}_i = is used as the first component of the state. 
On the other hand, if this trellis module is obtained from the 
trelUs module with value Cfc^^Ci^^ = 10> then cr^^-i = 1 is 
used as the first component of the state. We observe that all 
possible patterns of cr^^^, i.e., and 1 appear (a pattern of 
(y\}\ depends on the error in general). These observations 
can be generalized. 

Proposition 2: Consider any branch in the degenerate 
trellis module with value Denote by cr^k-i ststt at 
time fc — 1 of the branch. Assume that this degenerate trellis 
module is obtained from the trellis module with value C}^^ '' C}^\ 
Then 2"^ 12"^^ patterns of cr^^-i ViSQdi when viewed from 
the original trellis module. These sets of patterns are disjoint 
for different values of C}^^ and every possible patten of cr^^j^ 

(2) 

appears when C, ), over the 2™^ values. The total number 

of patterns of a^^l^ is (2''V2™2) x 2"'^ = 2"\ 

Proof: Consider any branch : cr')^li cr^-' in the 
degenerate trellis module with value C,^^\ When viewed from 

the original trellis module, given the Sk, the syndrome former 



goes from ak-i = (chilli, cr^^_^ J to crk = {cr)^^ ,cr 



(2) 



.(1) 



.(2) 



and 



outputs the syndrome C,^ = (Cfe^\ci^')- Here, the mapping: 

f2l f2^ 

Cj. i-> o-fcj.! is one-to-one. Since the number of values of 

(2) (2) 

C^l, is 2™^, the number of patterns of (y\_i corresponding to 
a particular value of ci,^' is 2''^ /2'^\ ■ 
Corollary 1: Assume that a degenerate trellis module with 
value Cfc^^ is obtained from a particular trellis module with 
value C'k^ C'k^ and consider the state cr^-' at time k in 
the degenerate trellis module. Then the number of branches 
entering state ct^^ is 2"~™ x 2"^ when viewed from the 
corresponding original trellis module. 

Proof: A branch coimecting state (T^^-i to state <7^^^ in 
a degenerate trelUs module corresponds to 2"'^ /2'^'^ branches 
when viewed from the original trelhs module. Also, since the 
size of Hi{D) is mi x n, the number of branches entering 
state (T^^^ is 2"-"'i. ■ 

Corollary 2: Assume that a degenerate trelUs module with 
value is obtained from a particular treUis module with 
value Ck^Ck^- In this case, the manner of branches entering 
the state cr]^ in the degenerate trellis module is equivalent 
to the manner of 2"~™ branches entering each of the 2'^^ 
extended states tJk = (crp\ cr|^^-'). 

Proof: The number of original states <r/c corresponding to 
the degenerate state cr^-' is 2"^. Also, since the size of H{D) 
is m X n, the number of branches entering state <Tfe in the 
original trellis module is 2""™. ■ 



IV. Decoding Based on a Degenerate Error 
Trellis 

A. Decoding Method 

Consider the decoding based on an error trellis constructed 
from a submatrix Hi{D) of H{D). In this method, the 
decoding is carried out by restoring the original trellis mod- 
ules using Proposition 1. For the purpose, the syndrome- 
subsequence {Ci^^} computed from H2{D) is utilized as 
auxiliary information for decoding. Let (t\}\ be the initial 
state of any branch in the degenerate trellis module. Since 

(2) 

there are 2"^ possibilities with respect to the patterns of <t^_^ 
(cf. Proposition 2), we retain 2''^ survivors for the degenerate 
state (Tj^li- The decoding procedure is given as follows. 

Decoding based on a degenerate trellis 

Step 1: Consider any state cr^^-* at time k in the degenerate 
trellis module. The state cr^^^ has 2"""*! incoming branches. 
Take one such incoming branch. Denote by the state at 

time /c — 1 of the branch. Note that 2"^ survivors are retained 
for the state c'^^li- Extend these survivors along the branch 
under consideration. Then we have 2"^ extended paths. Repeat 
this procedure for each branch entering state <t^^'. As a result, 
we have 2"= x 2"~™i extended paths in total. 

Step 2: Discard the extended paths which are not consistent 
with the value of ^ • The number of remaining paths is 

Step 3: Classify the remaining paths into 2"^^ groups accord- 

(2) _ 

ing to the patterns of cr^ , where each group contains 2" 
paths. Then the best path among each group is selected and 
the 2'^^ survivors for the state cr^^ are newly determined. 
Step 4: Repeat Step 1 ^ Step 3 for each state cr']^\ 
Remark: Step 2 and Step 3 correspond to Corollary 1 and 
Corollary 2 in Section III-B, respectively. 

B. Decoding Complexity 

We evaluate the decoding complexity based on the error 
trellis associated with H^{D). We have the following. 

Proposition 3: The total number of survivors required in 
the decoding based on Hi{D) is 2^ . 

Proof: 2"'^ survivors are retained for each state in the 
trellis based on HfiD). ■ 

Proposition 4: The number of compare-and-select compu- 
tations required in the decoding based on Hi{D) is 2", 
where one path is selected from among 2"~™ paths in the 
computation. 

Proof: A direct consequence of Step 3 in the decoding 
procedure. ■ 

In the proposed method based on H'[{D), a kind of list 
decoding [4] is required. However, the decoding complexity 
of the proposed method remains unchanged, except for the 
additional complexity of discarding the extended paths which 
are not consistent with the value of C^^^- 
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Fig. 6. A 1-state error trellis based on h'^{D). 

V. Decoding Based on a 1 -State Error Trellis 

A. Check Matrices Based on Circulant Matrices and 1 -State 
Error Trellises 

Tanner et al. [10] proposed LDPC convolutional codes 
defined by check matrices whose entries are all monomials. 
As an example [10, Example 7], take 

H{D)=^j^, ^2 1 j, (7) 

where a common factor in each row has been removed. 
{Remark: The above H{D) is not basic and then not canonical. 
However, the preceding argument is also effective.) In this 
case, if we choose any row of H{D) for the purpose of 
constructing an error trellis for decoding, then a 1-state error 
trellis is obtained by factoring out a factor from each 
entry of the row. In order to clarify the idea, again consider 
the check matrix H{D) given in (3). Since the first entry of 
H2{D) = {D, 1, 1) has a factor D, we can apply the error- 
trellis construction method in [9]. Let e^^^^ = De'j^^ = e^.^^! 
and define as = e^^\ e^.^^). We have 

/ 1 + 1 \ 

C. = (e.^^ei^),ef) D 1 

= eUH[^{D),H2^{D))=e',H'^{D). (8) 

Since H2{D) = (1,1,1), the error paths associated with 
H^iD) are represented using a 1-state error trellis |9|. A 1- 
state error trellis equivalent to the one in Fig. 4 is shown in 
Fig.6. Since the two trellises in Fig.4 and Fig.6 are equivalent, 
the decoding method stated in Section IV-A can be mapped 
on the error trellis in Fig.6. Actually, we can regard H'{D) 
as a given check matrix and then apply our method to it. 
Since the constraint length of H[{D) = (1 + D-^,D, 1 + D) 
is 2, if 4 survivors are retained, then ML decoding is ac- 
complished. Applying the method, we have the decoded path 
e' = 000 000 100 000 100 000 (cf. e). Though the ML 
decoding is realized using the above method, the decoding 
complexity is not reduced compared to the original one. In the 
following, therefore, we propose a simplified decoding method 
taking into account a feature of error trellises. 

B. Likelihood Distribution of the Trellis-State and Sub- 
Optimal Decoding 

Note that only eight paths in the error trellis in Fig.6 are 
admissible. As a result, the principle of optimality does not 
hold for the error trelUs in Fig.6. That is, the error path 
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TABLE I 
90 ~ 96 AND THEIR SUM VERSUS €. 



e 


90 


9i ~ 91 


95 ~ 98 


E,-n3i 


0.1 


0.49 


0.02 


0.01 


0.59 


0.05 


0.6225 


0.055 


0.0275 


0.8975 


0.01 


0.9049 


0.0182 


0.0091 


0.9959 


0.005 


0.951225 


0.00955 


0.004775 


0.998975 


0.001 


0.990049 


0.001982 


0.000991 


0.999959 



with minimum weight which is consistent with the values 
of {Cp^}t=i is not necessarily consistent with the values of 
{C(^'}/Li at the final time N. However, it is reasonable to 
imagine that an error path with low weight which is consistent 
with {Cj^^lt^i is likely to become the overall optimal path 
at time N. Here, take notice of a feature of error trellises. 
Again consider the check matrix H{D) given in (7). Let 

^ i)ef = e^^l, and e^'^ ^ D^ef = e^^l,. Also, 



define as e'j. = (e^^' , e J 



'(2) J(3) 



(4 



(1) '{2) '(3) 



). Then we have 
1 £)3 



D 

D-3 



A 



(9) 



The time-fc state of the error trellis based on H^{D) is 



expressed as 



=(1) 



1 + ^k+\ 



'(2) ^(1) ^ '(2) 



+ e 



fe+2' 



, /(2) „(1) 



)■ 



(10) 



Let e = P{e^^ 



J, — 1) be the channel crossover probability. 
Denote by gg and qi (1 < i < 6) the probabilities of the 
all-zero state and the state with O's except for the ith entry, 
respectively. Qq ~ gg are given as follows. 

q-o = (l-2e + 2eY(l-ef 
= e(l-2e + 2e2)^(l-e). 



91 
95 



96 



The values of ~ 96 and their sum versus e are shown 
in TABLE I (evaluated up to order e^). In this example, the 
sum is greater than 0.99 for e < 0.01. We see a likelihood- 
concentration [7] occurs in the all-zero state and the states 
with many O's. Hence, we choose as survivors the error paths 
with M (< 2"^) lowest weights from among the paths which 
have passed the syndrome test (i.e., M-algorithm [2], [11]). 
The decoding procedure is given as follows. 

Decoding based on a 1 -state error trellis 

Step 1: (Let Hi{D) = hi{D).) Suppose that M survivors 
are retained at time k-\-v^^'' — 1. Extend these survivors by the 
unit time based on the error trellis associated with h^{D). 
We have M x 2"~^ extended paths in total. 

Step 2: Discard the extended paths which are not consistent 

(2) 

with the value of • The number of remaining paths is M x 

2n-i/2'"-i = 2"""* X M. 



Step 3: Order the remaining paths by their metrics (weights) 
and select the best M paths as the survivors at time k + v^^\ 

A Viterbi algorithm making use of a likelihood distribution 
of the state in a code trellis was proposed in [7]. A similar 
idea combined with the M-algorithm is described in [11]. It 
is shown [11] that M can be reduced to 16 within a very 
small degradation compared to ML decoding for a (2,1,8) 
convolutional code (cf. the number of trelhs states S = 256). 
(It is stated [2] that M « \/5 is asymptotically optimal for 
large codes.) Since a likelihood-concentration occurs in error 
trellises, the method is also effective for error trellises. 

VI. Conclusion 

We have presented a decoding method using an error trellis 
constructed based on a submatrix of a given check matrix. In 
this method, the given check matrix is partitioned into two sub- 
matrices and one is used for error-trellis construction, whereas 
the other is used for generation of auxiUary information for 
decoding. We have shown that the ML error path is correctly 
decoded using the degenerate error trellis based on the former 
submatrix, if the syndrome-subsequence computed from the 
latter is utilized as side information for decoding. Next, we 
have applied the method to check matrices with monomial 
entries proposed by Tanner et al. It is shown that by choosing 
any row of the check matrix as the submatrix for error-trellis 
construction, a 1-state error trellis is obtained. Taking into 
account a significant feature (i.e., a likelihood-concentration 
on the all-zero state and the states with many O's), we have 
proposed a simplified decoding method (M-algorithm) based 
on a 1-state error trelUs, from which decoding-complexity 
reduction is reaUzed. 
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